BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on REG-TOTAL events by Ev. Decom. - Approx. Span & Recur. matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ UTurku  ]       ==[REG-TOTAL]==       1940 (  784)     1408 (  784)    40.41    55.68    46.83
[JULIELab ]       ==[REG-TOTAL]==       1940 (  777)     1721 (  777)    40.05    45.15    42.45
[ConcordU ]       ==[REG-TOTAL]==       1940 (  618)     1040 (  618)    31.86    59.42    41.48
[UT+DBCLS ]       ==[REG-TOTAL]==       1940 (  607)     1168 (  607)    31.29    51.97    39.06
[VIBGhent ]       ==[REG-TOTAL]==       1940 (  401)      950 (  401)    20.67    42.21    27.75
[  UNSW   ]       ==[REG-TOTAL]==       1940 (  386)      962 (  384)    19.90    39.92    26.56
[ UZurich ]       ==[REG-TOTAL]==       1940 (  351)      805 (  351)    18.09    43.60    25.57
[ UTokyo  ]       ==[REG-TOTAL]==       1940 (  315)      741 (  315)    16.24    42.51    23.50
[   Cam   ]       ==[REG-TOTAL]==       1940 (  233)      455 (  233)    12.01    51.21    19.46
[UAntwerp ]       ==[REG-TOTAL]==       1940 (  245)      678 (  245)    12.63    36.14    18.72
[  SCAI   ]       ==[REG-TOTAL]==       1940 (  293)     1269 (  293)    15.10    23.09    18.26
[ Team 24 ]       ==[REG-TOTAL]==       1940 (  207)      801 (  206)    10.67    25.72    15.08
[CNBMadrid]       ==[REG-TOTAL]==       1940 (  413)     3659 (  412)    21.29    11.26    14.73
[  UMich  ]       ==[REG-TOTAL]==       1940 (  360)     3845 (  360)    18.56     9.36    12.45
[  NICTA  ]       ==[REG-TOTAL]==       1940 (  167)      751 (  167)     8.61    22.24    12.41
[ UAveiro ]       ==[REG-TOTAL]==       1940 (  146)      494 (  146)     7.53    29.55    12.00
[ASU+HU+BU]       ==[REG-TOTAL]==       1940 (  122)      257 (  122)     6.29    47.47    11.11
[CIPS-ASU ]       ==[REG-TOTAL]==       1940 (  224)     2404 (  224)    11.55     9.32    10.31
[ USzeged ]       ==[REG-TOTAL]==       1940 (   94)      379 (   94)     4.85    24.80     8.11
[ UNIMAN  ]       ==[REG-TOTAL]==       1940 (   84)      400 (   84)     4.33    21.00     7.18
[CCP-BTMG ]       ==[REG-TOTAL]==       1940 (   58)      115 (   58)     2.99    50.43     5.64
[ Team 09 ]       ==[REG-TOTAL]==       1940 (   49)      335 (   49)     2.53    14.63     4.31
[  PIKB   ]       ==[REG-TOTAL]==       1940 (   25)       59 (   25)     1.29    42.37     2.50
[ KoreaU  ]       ==[REG-TOTAL]==       1940 (   13)       32 (   13)     0.67    40.62     1.32

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ]       ==[REG-TOTAL]==       1994 (  614)     1180 (  614)    30.79    52.03    38.69
[UAntwerp ]       ==[REG-TOTAL]==       1994 (  256)      698 (  256)    12.84    36.68    19.02
[ Team 24 ]       ==[REG-TOTAL]==       1994 (  220)      819 (  219)    11.03    26.74    15.62
[CNBMadrid]       ==[REG-TOTAL]==       1994 (  436)     4280 (  435)    21.87    10.16    13.88
[ASU+HU+BU]       ==[REG-TOTAL]==       1994 (  122)      257 (  122)     6.12    47.47    10.84
[CCP-BTMG ]       ==[REG-TOTAL]==       1994 (   58)      115 (   58)     2.91    50.43     5.50

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------